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ABSTRACT 



A method for displaying a digital color image to a visually 
impaired person, includes the steps of: measuring the visual 
response of the person and specifying a set of enhancement 
profiles relating to the person's color and spatial frequency 
visual perception, adjusting the color content of the digital 
color image in response to a color content enhancement 
profile; adjusting the spatial frequency content of the image 
in response to a spatial frequency profile; adjusting the 
contrast of the image in response to a contrast adjustment 
profile; and displaying the adjusted digital image to the 
person. 

21 Claims, 5 Drawing Sheets 
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METHOD AND APPARATUS FOR graph is simply placed into a reader and either viewed or 

DISPLAYING PICTORIAL IMAGES TO printed out. Additionally, when compared to the image 

INDIVIDUALS WHO HAVE IMPAIRED processing disclosed in U.S. Pat. No. 5,467,123, the present 

COLOR AND/OR SPATIAL VISION invention produces a more natural looking image with 

5 enhanced discrimination. 



FIELD OF THE INVENTION 

This invention relates to the field of display devices and 
particularly to the methods and apparatus for the improve- 
ment of color and spatial discrimination of pictorial images 10 
for viewers with vision impairment. 

BACKGROUND OF THE INVENTION 

At present, when a person wants to view a photographic 5 
print he simply picks it up and looks at it. However, a person 
with a visual impairment cannot fully participate in the 
pleasure of photography due to their lack of visual acuity. 
The visual shortcomings of these people are partially 
addressed in U.S. Pat. No. 5,267,331 by Siwoff issued Nov. w 
30, 1993, entitled Digitally Enhanced Imager for the Visu- 
ally Impaired, wherein a device is described which scans a 
page of text and creates a high resolution, high contrast 
image which is displayed upon a high resolution monitor. 
This enhancement of text eliminates any "gray" transitions ^ 
between the text and the background thereby improving 
resolution. However this process is not applied to pictorial 
images because it does not improve the appearance of the 
pictorial image for a person with visual impairment. Also, 
U.S. Pat No. 5,467,123 issued Nov. 14, 1995 to Zeevi et al., 3Q 
entided Apparatus & Method for Enhancing Color Images 
discloses a color image apparatus comprising apparatus for 
receiving signals representing a color image, image process- 
ing apparatus, and display device for displaying the pro- 
cessed signal. The image signal is processed to improve the 35 
appearance of the image for viewers who are color blind. 
Trie image processing extracts information that cannot be 
detected by the user (ex. yellow-blue signals) and adds the 
extracted information to a channel the user can detect (ex. 
red-green) thus enhancing their visual discrimination. This ^ 
approach renders an image that appears extremely unnatural 
to any viewer, including a viewer that is color blind. There 
is a need, therefore, for an improved method and apparatus 
for displaying pictorial images to individuals who have 
impaired color and/or spatial discrimination. 45 

SUMMARY OF THE INVENTION 

The present invention meets the need by providing a 
method for displaying a digital color image to a visually 
impaired person that includes the steps of: measuring the 50 
visual response of the person and specifying a set of 
enhancement profiles relating to the person's color and 
spatial frequency visual perception, adjusting the color con- 
tent of the digital color image in response to a color content 
enhancement profile; adjusting the spatial frequency content 55 
of the image in response to a spatial frequency profile; 
adjusting the contrast of the image in response to a contrast 
adjustment profile; and displaying the adjusted digital image 
to the person. 

This method and display apparatus, which will be 60 
explained in full detail below, enables a visually impaired 
person to take any image, whether digital or hardcopy, 
enhance that image according to a measured profile, and 
output that image to either a monitor or a hard copy output 
device. This method has a distinct cost and logistical advan- 65 
tage. Rather than producing customized output such as 
photographs for each visually impaired person, the photo- 



BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram showing apparatus for practic- 
ing the method of the present invention; 

FIG. 2 is a diagram useful in explaining the image 
processing algorithm used in the present invention; 

FIG. 3 is a flowchart showing the steps of adjusting of 
color content of an image according to the present invention; 

FIG. 4 is a flowchart showing the steps of adjusting the 
contrast content of an image according to the present inven- 
tion; and 

FIG. 5 is a flowchart showing the steps of adjusting the 
spatial frequency content according to the present invention. 

DETAILED DESCRIPTION OF THE 
INVENTION 

Referencing first to FIG. 1, an image reading device 10 
constructed and operative in accordance with the present 
invention, includes a color signal separation circuit 20 
whose function is to separate the color channels from an 
image source 30 so that individual components are ready for 
the next step of image adjustment. These signals are sepa- 
rated into a luminance and two chrominance described as 
Red/Green, Blue/Yellow, and Black/White, and are indi- 
cated in the figure as R/G, B/Y, and BIVW. 

An enhancement module 40 includes a color content 
section 50, a contrast content adjustment section 60, and a 
spatial content adjustment section 70. These adjustments 
within enhancement module 40 of color section 50, contrast 
section 60, and spatial content section 70 occur sequentially 
but the order and number of adjustments can be different 
based on the application. 

After the adjustments have been made to the signals, they 
are sent to control and recombination circuitry 80 where 
they are recombined into an R, G, B signal, which are in turn 
output to a display screen 90 or a hard copy printer 100. The 
display screen 90 can be for example a television receiver, 
a computer monitor, a personal digital assistant, an elec- 
tronic picture frame, a data display, or a control panel. The 
apparatus detailed in FIG. 1 could be implemented either by 
a software programmed personal computer or by a hardware 
programmed ASIC device such as those produced by Texas 
Instruments Corporation, Dallas Tex., wherein specific 
needs at the time of production would determine specific 
device part numbers. 

A measured subject profile 110 is determined by measur- 
ing the visual responses and preferences of the user. This 
measured subject profile 110 is employed to selectively 
modify the gain or attenuation in sections 50, 60 and 70, thus 
rendering a pictorial image with more useable information 
for a person who has impaired color and/or spatial discrimi- 
nation. The measurement of a users visual response is 
accomplished by displaying first a series of color patterns to 
the user, and based upon the user's responses, a color 
discrimination characteristic of the user is derived. 
Secondly, a series of sinusoidal grayscale gratings are dis- 
played to the user and based upon the responses, a lumi- 
nance discrimination characteristic is measured. Lastly, the 
preference measurement is accomplished by displaying a 
series of images with different color saturation, color 
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balance, and lone scale curves. The user will then be asked rithm 290 is enhanced Red/Green' 255, Blue/Yellow' 265 

to indicate which images he/she prefers. The format of the and unmodified luminance 270. 

subject profile consists of a series of numbers representing Referring now to FIG. 4, the contrast is adjusted using 

the aforementioned user preferences associated with a par- algorithm 300 according to the contrast parameters defined 

ticular scene content. These numerical values represent the 5 in measured subject profile 110. Unmodified luminance 270 

gain factors for color content adjustment section 50, contrast is adjusted with contrast modification algorithm 300. The 

adjustment section 60, and spatial content adjustment sec- luminance value in profile 110 is determined by comparing 

tion 70 which are detailed in FIG. 1. the subject's response to that of an average normal observer 

Referring now to FIG. 2, the enhancement algorithms that and me difference between these two responses determines 

are used in the present invention will be described in more 1° ^ g 3 ^ for the enhancement algorithm 180. This value 

detail. The digital image 115 is comprised of digital image could a^o be determined by the user's preference. Once the J 

content 120 and represented by equation 125 which is modifications are complete, the color contents 255 and 265 

written as I^^+B^+C^+G^. I (c) is the representation of alon g wiu modified luminance content 275 is recombined 

the image components where represents the color con- using algorithm 310 and sent to the spatial frequency 

tent of the image, represents the spatial content of the * 5 adjustment step illustrated in FIG. 5. 

image, represents the mid-tone contrast of the image, Decomposing the spatial content of the digital image 120 

and G x4 represents other relevant content characteristics of occurs in step 320 by using either a standard fast Fourier 

the image such as tone scale. transform function or a standard discrete cosine transform. 

The digital image 115 is fed to decomposition algorithm Both these functions are well known to those skilled in the 

130 which in turn separates the digital image 115 into it's 20 arL ^ measured subject profile 110 includes a spatial 

constituent attributes 140, 150, 160, and 170. Attribute 140 C0Dtent P^ter that is determined by measuring the 

represents the color content of the image, attribute 150 coM .^ 1 . *f«™ty function of the subject The contrast 

represents the spatial content of the image (for example, the sensitivity function of the subject is measured by the sinu- 

spatial content of the image can be represented as a spatial S0ldal 1 S ratm g method described previously The 

frequency profile specified by a plurality of spatial fre- 25 s P aUal conte J nt attributes are modified in step 330 based on 

quency band pass filters), attribute 160 represents the mid- ^ c measured subject profile 110. The spatial content value 

tone contrast content of the image, and attribute 170 repre- m P rofile U0 _ 1S *>tennined by comparing the subject s 

sentsotherrelevantcontentcharacteristicsoftheimagesuch ^J 00 * l ° of u an avera S e normal J observer «"» the 

as tone scale difference between these two responses determines the gain 
_ , . .. , ,30 for the enhancement algorithm 180. The modified signal is 

Depending on the .individual steps of the adjustments the ^ ^ tQ ^ fof recombination md tbe adjusted ^ 

decomposition of the image will use different algonthms, ^ fc ^ d It should ^ noted mat recombination 

stored in decomposition algorithm database 135, and occurs si ^ 31Q shown {q mQ 4 reC ombination algorithm 

sequentially within decomposition algorithm box 130. This ^ ^ FJG 2 and recombination circuitry 80 shown 

step is repeated for each individual attribute. 35 ^ mQ t ^ the same step ^ lisa hardware step; Ha 

For each individual attribute, these components are modi- 2 could be either a software or hardware step; FIG. 4 could 

fled by enhancement algorithm 180 that changes the char- be e i mer a software or hardware step, 

acteristics of attributes 140, 150, 160, and 170 according to Id addition, the subject's visual response for different 

the subject profile 110. For example, the characteristic of the subject matter can be measured, and the digital image 

color content is saturation and this value is attenuated or 40 adjusted according to the subject matter contained in the 

amplified. Similar operations will occur for the other digital image. For example, the individuals response to*V 

attributes. Once the enhancement algorithm 180 is applied, scenes containing human faces and scenes not containing I 

the enhanced attributes 190, 200, 210, and 220 are recom- human faces can be measured, and when there is a difference I 

bined by adding them together in recombination algorithm m response, the scenes can be modified accordingly. J 

230 that produces the enhanced digital image l (c) * 240 which 45 The invention has been described in detail with particular 

is represented as follows: reference to certain preferred embodiments thereof, but it 

will be understood that variations and modifications can be 
effected within the spirit and scope of the invention. 

PARTS LIST 



S FIG. 3 further describes the decomposition of color con- 
tent in the digital image 120. The digital image 120 is 50 
decomposed into its respective color components of Red/ 10 image reading device 
Green 250, Blue/Yellow 260, and luminance 270 signals. 20 color signal separation circuit 
The decomposition algorithm 280 includes components 250, 30 image source 
260, and 270. Decomposition algorithm 280 is one step in 40 enhancement module 
the decomposition algorithm 130, as shown in FIG. 2, which 55 50 color section 
complements color signal separation circuit 20 as shown in 60 contrast section 
FIG. 1. 70 content section 
r""" 7 'Modification algorithm 290 modifies color components 80 recombination circuitry 
\ 250 and 260 according to the measured subject profile 110. 90 display screen 
1 Mathematical operations within modification algorithm 290 60 100 hard copy printer 
1 are either amplification or attenuation of color signals Red/ 110 measured subject profile 
J Green 250 and Blue/Yellow 260 according to the parameters 115 digital image 
Y~ defined in the measured subject profile 110. The profile 110 120 image content 
**^is determined by comparing the subject's response to that of 125 equation 

an average normal observer and the difference between these 65 130 decomposition algorithm 

two responses determines the gains for the enhancement 135 database 

algorithm 180. The resulting output of modification algo- 140 color content attribute 
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150 spatial content attribute 
160 mid-tone contrast attribute 
170 other relevant characteristic attribute 
180 enhancement algorithm 
190 enhanced color content attribute 
200 enhanced spatial content attribute 
210 enhanced mid-tone contrast attribute 
220 enhanced other relevant characteristic attribute 
230 recombination algorithm 
240 enhanced digital image 
250 Red/Green color component 
255 enhanced Red/Green 
260 Blue/Yellow color component 
265 enhanced Blue/Yellow 
270 luminance signal 
275 modified luminance content 
280 decomposition algorithm 
290 modification algorithm 
300 contrast adjustment algorithm 
310 recombination algorithm 
320 spatial decomposition step 
330 modify spatial content step 
340 sent modified signal step 
350 adjusted image 
What is claimed is: 

1. A method for displaying a digital color image to a 
visually impaired person, comprising the steps of: 

a) measuring the visual response of the person and 
specifying a set of enhancement profiles relating to the 
person's color and spatial frequency visual perception, 

b) adjusting the color content of the digital color image in 
response to a color content enhancement profile; 

c) adjusting the spatial frequency content of the image in 
response to a spatial frequency profile; 

d) adjusting the contrast of the image in response to a 
contrast adjustment profile; and 

e) displaying the adjusted digital image to the person. 

2. The method claimed in claim 1, further comprising the 
steps of measuring the person's visual response for different 
subject matter, and adjusting the digital image according to 
the subject matter contained in the digital image. 

3. The method claimed in claim 2, wherein the subject 
matter includes scenes containing human faces and scenes 
not containing human faces. 

4. The method claimed in claim 1, wherein the spatial 
frequency profile specifies a plurality of spatial frequency 
band pass filters. 

5. The method claimed in claim 1 wherein the display is 
a television receiver. 
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6. The method claimed in claim 1 wherein the display is 
a computer monitor 

7. The method claimed in claim 1, wherein the display is 
a personal digital assistant. 

8. The method claimed in claim 1, wherein the display is 
an electronic picture frame. 

9. The method claimed in claim 1, wherein the display is 
a data display. 

10. The method claimed in claim 1, wherein the display 
is a control panel. 

11. Apparatus for displaying a digital color image to a 
visually impaired person, comprising: 

a) means responsive to a personal color content enhance- 
ment profile for adjusting the color content of the 
digital color image; 

b) means responsive to a personal spatial frequency 
enhancement profile for adjusting the spatial frequency 
content of the digital color image; 

c) means responsive to a contrast adjustment profile for 
adjusting the contrast of the digital color image; and 

d) a display for displaying the adjusted digital color image 
to the person. 

12. The apparatus claimed in claim 11, further including 
means for adjusting the digital color image according to 
subject matter categories contained in the digital color 
image. 

13. The apparatus claimed in claim 12, wherein the 
subject matter categories includes scenes containing human 
faces and scenes not containing human faces. 

14. The apparatus claimed in claim 11, wherein the spatial 
frequency profile specifies a plurality of spatial frequency 
band pass filters. 

15. The apparatus claimed in claim 11 wherein the display 
is a television receiver. 

16. The apparatus claimed in claim 11 wherein the display 
is a computer monitor. 

17. The apparatus claimed in claim 11, wherein the 
display is a personal digital assistant. 

18. The apparatus claimed in claim 11, wherein the 
display is an electronic picture frame. 

19. The apparatus claimed in claim 11, wherein the 
display is a data display. 

20. The apparatus claimed in claim 11, wherein the 
display is a control panel. 

21. A computer storage medium having instruction stored 
therein for causing a computer to perform the method of 
claim 1. 
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